Minimal polynomial and reduced rank extrapolation methods are related
نویسنده
چکیده
Minimal Polynomial Extrapolation (MPE) and Reduced Rank Extrapolation (RRE) are two polynomial methods used for accelerating the convergence of sequences of vectors {xm}. They are applied successfully in conjunction with fixedpoint iterative schemes in the solution of large and sparse systems of linear and nonlinear equations in different disciplines of science and engineering. Both methods produce approximations sk to the limit or antilimit of {xm} that are of the form sk = ∑ki=0 γixi with ∑k i=0 γi = 1, for some scalars γi . The way the two methods are derived suggests that they might, somehow, be related to each other; this has not been explored so far, however. In this work, we tackle this issue and show that the vectors s k and s RRE k produced by the two methods are related in more than one way, and independently of the way the xm are generated. One of our results states that RRE stagnates, in the sense that s k = s k−1, if and only if s k does not exist. Another result states that, when s k exists, there holds μks RRE k = μk−1sRRE k−1 + νksMPE k with μk = μk−1 + νk, for some positive scalars μk , μk−1, and νk that depend only on s k , s k−1, and s k , respectively. Our results are valid when MPE and RRE are defined in any weighted inner product and the norm induced by it. They also contain as special cases the known results pertaining to the connection between the method of Arnoldi and the method of generalized minimal residuals, two important Krylov subspace methods for solving nonsingular linear systems. Communicated by: Raymond H. Chan Avram Sidi [email protected] http://www.cs.technion.ac.il/∼asidi 1 Computer Science Department, Technion Israel Institute of Technology, Haifa 32000, Israel
منابع مشابه
Recursive Algorithms for Vector Extrapolation Methods
In this work we devise three classes of recursion relations that can be used for implementing some extrapolation methods for vector sequences. One class of recursion relations can be used to implement methods like the modified minimai polynomial extrapolation and the topological epsilon algorithm, another allows implementation of methods like minimal polynomial and reduced rank extrapolation, w...
متن کاملExtrapolation vs. projection methods for linear systems of equations
It is shown that the four vector extrapolation methods, minimal polynomial extrapolation, reduced rank extrapolation, modified minimal polynomial extrapolation, and topological epsilon algorithm, when applied to linearly generated vector sequences, are Krylov subspace methods, and are equivalent to some well known conjugate gradient type methods. A unified recursive method that includes the con...
متن کاملApplication of Vector Extrapolation Methods to Consistent Singular Linear Systems
Consider the linear system of equations Bx = f, where B is an N x N singular matrix, but the system is consistent. In this work we show that iterative techniques coupled with vector extrapolation methods can be used to obtain (approximations to) a solution of Bx = f. We do this by extending the results of some previous work on vector extrapolation methods as they apply to nonsingular matrices B...
متن کاملEfficient Implementation of Minimal Polynomial and Reduced Rank Extrapolation Methods
The minimal polynomial extrapolation (MPE) and reduced rank extrapolation (RRE) are two very effective techniques that have been used in accelerating the convergence of vector sequences, such as those that are obtained from iterative solution of linear and nonlinear systems of equations. Their definitions involve some linear least squares problems, and this causes difficulties in their numerica...
متن کاملI t 1 EXTRAPOLATION vs PROJECTION METHODS FOR LINEAR SYSTEJ
It is ,shown that the four, vectof extrapolation methods. minimal polynomial extrapolation. reduced rank extrapolation. modified minimal polynomial extrapolation. and topological epsilon algorithm. when appiied to linearly generated vector sequences. are Krylov subspace methods. and· a~ equivalent to some well known conjugate gradient type methods., A unified recursive method thaJ includes the ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Adv. Comput. Math.
دوره 43 شماره
صفحات -
تاریخ انتشار 2017